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simulation  in  conjunction  with  empirical  behavioral  science  methods  can  provide  the  Army  with  the  much 
needed  tools  for  analysis  in  support  of  the  Soldier. 
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•  Army  has  an  interest  in  the  Modeling  and  Simulation  of  squads  in 
support  of  acquisition  and  training  decisions 

•  Leadership,  training,  and  cohesiveness  are  variables  of  interest 

•  An  initial  review  of  the  literature  reveals  that  archived  information  is  of 
insufficient  granularity  to  simply  “insert”  into  Modeling  and  Simulation  of 
squads 

•  Data  collection  under  controlled  conditions  is  necessary  to  collect 
empirically  derived  quantitative  relationships  among  leadership,  training, 
and  cohesiveness  measures  and  squad  performance 

•  An  initial  proposal  for  methods  and  procedures  to  collect  this  data  is 
presented 
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•  Develop  an  Integrated  decision  support  layout  that  maximizes  squad  capabilities 
and  enhances  squad  portfolio  management  across  full  Doctrine,  Training, 
Leadership,  Organizations,  Materiel,  and  Personnel,  Facilities  (DTLOMP-F): 

-  Establish  squad  objective  measures  that  set  the  conditions  to  generate 
command  consensus  and  vision  for  squad 

•  Performance  attributes 

•  Enabling  attributes 

•  Measures  of  formation  effectiveness 

-  Mechanism  that  recognizes,  uses,  feeds  and  builds  body  of  knowledge  IRT 
Leadership,  Training,  and  Materiel  for  the  squad 

•  Assess  potential  leadership,  training,  and  products/technologies  and  measure  the 
payoff  for  the  squad 

-  Incorporate  an  operational  context  /  language  for  assessments 

•  Enables  effective  communication  of  resource  requirement  decisions  and  priorities  across 
stakeholders  community  (aka  Squad  Capability  Portfolio  Review) 

•  Establish  habitual  relationships  within  the  acquisition  &  operational  communities  to 
ensure  currency  &  relevancy  for  squad 


From  A.  Taylor  “Squad  Measures  of  Formation  Effectiveness” 
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•  The  ARDEC  effort  in  systems  engineering  and  analysis  is  proposed  to 
be  an  integral  part  of  analyses  of  candidate  materiel  and  personnel 
solutions 

•  Because  of  its  focus  on  small  unit  modeling  and  simulation,  the  Infantry 
Warrior  Simulation  (IWARS)  software  application  was  selected  as  the 
software  platform  to  conduct  these  systems  analyses 

•  The  intent  is  to  demonstrate  the  utility  of  M&S,  in  particular,  IWARS  in 
analysis  of  candidate  solutions,  especially  in  the  area  of  determining 
effectiveness  and  realizing  cost  savings 

•  As  part  of  the  ARDEC  contribution  to  the  effort,  the  Target  Behavioral 
Response  Laboratory  (TBRL)  was  tasked  with  the  development  of 
methods  to  incorporate  laboratory  data  from  human  experimentation  into 
the  IWARS 
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Leadership,  Training,  and 
Cohesiveness  Factors 


•  Leadership,  Training,  and  Cohesiveness  Factors  are  particularly 
problematic 

•  TBLR  Effort  =  Two  Approaches 

-  Review  of  the  literature  for  previous  work  on  how  these  factors  relate 
to  squad  performance 

-  Empirical  approaches  for  gathering  data 

•  Analysis  of  how  these  factors  could  be  incorporated  into  modeling  and 
simulation  of  squads 
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•  A  constructive,  force-on-force,  combat  simulation 

•  Used  to  model  individual  Soldier,  team,  and  small-unit  combat 
operations  in  complex  environments,  including  Military  Operations  on 
Urban  Terrain  (MOUT),  to  support  analysis  of  warrior  systems 


•  Key  measures  of  interest  for  analyses  performed  using  IWARS  include 
survivability,  lethality,  command  and  control,  situation  awareness, 
mobility,  and  sustainability 


•  The  primary  IWARS  simulation  objects  are  intelligent  agents  that  are 
semi-autonomous,  which  allows  realistic  modeling  of  soldier  and  unit 
behaviors 


•  The  behavior  engine  uses  goal-driven  behaviors  that  can  be  interrupted 
and  adapted  as  the  combatant’s  needs  and  goals  change  over  the 
course  of  a  scenario 

•  Agents  can  also  interact  with  each  other,  which  could  potentially  affect 
decision-making  activities 


IWARS  agents  have  the  ability  to  perform  operational  tasks  related  to: 

-  movement 

-  engagement 

-  communication 

-  perception 


-  decision-making 
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•  Skills  are  the  most  basic  behaviors  available  to  agents 

•  When  a  skill  is  added  to  a  mission,  it  becomes  an  activity  that  can  be 
renamed  and  modified 

•  IWARS  skills  include: 


Activate  Motion 

•  Change  Agent  Facing 

•  Change  Field  of 

Change  Posture 

•  Change  Vehicle  Facing 

•  Change  Visual 

Communicate 

•  Configure  COP  Access  Point 

•  Dismount  Vehicle 

Drive  Vehicle 

•  Follow 

•  Light  Flare 

Look  for  Shield 

•  Mount  Vehicle 

•  Move 

Reload 

•  Remove  Message 

•  Select  Weapon 

Set  Behavior 

•  Set  Formation 

•  Set  Path 

Set  UDOP  Profile 

•  Shoot 

•  Take  Over  a  Slot 

Throw  Grenade 

Wait 

•  Use  Shield 

•  Use  UDOP  Device 

from  IWARS  4.0  User  Guide 
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Warrior  Battle  Drills  2011 


Subject  Area  16:  (Battle  Drills)  React  to  Contact: 

rasfcjYuflife^r 

Tills 

Training  Location 

Su-staLfiffUTir  Training 
Frequency 

071410-0002 

React  to  Direct  Fire  While  Mounted  (Repeat) 

BCTOSUT 

SA 

071-326-0513 

Select  lemporary  Fighting  Positions  (Repeat) 

BCT  OSUT 

SA 

071-100-0030 

Engage  Far  gets  with  an  Ml6-Series  Rifle '  M4  Series  Carbine 
(Repeat) 

BCTOSUT 

SA 

071-32M603 

Use  Visual  Signaling  Techniques  (Repeat) 

BCTOSUT 

AN 

071-326-0502 

Move  under  Direct  Fire  (Repeat) 

BCTOSUT 

SA 

071-326-0503 

Move  O'er.  Through;  or  Around  Obstacles  (Except 

Minefields)  (Repeat) 

BCT  OSUT 

SA 

071-326-0510 

React  to  Indirect  Fire  While  Dismounted  (If  Applicable) 

(Repeat) 

React  to  Indirect  Fire  While  Mounted  (If  Applicable)  (Repeat) 

BCT  OSUT 

SA 

071-326-3002 

BCTOSUT 

SA 

113-571-1022 

Perform  Voice  Communications  (Repeat) 

BCTOSUT 

AN 

071-326-0501 

Move  as  a  member  of  a  Fire  Team  (Repeat) 

BCTOSUT 

SA 

071-3254407 

Employ  Hand  Grenades  (Repeat) 

BCTOSUT 

AN 
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Live,  Virtual,  Constructive  (LVC) 
Simulated  Testing 


•  Real  individual  Soldier  behavior  vs  IWARS  Soldier  behavior 


Activate  Motion 
Change  Posture 
Communicate 

Drive  Vehicle 

[.nnk  for 

eload 


Set  Behavior 

Set  UDOP  Profile 
Throw  Grenade 


<STWalt 


IWARS  Skills 


Change  Agent  Facing 
Change  Vehicle  Facing 
Configure  COP  Access  Point 
Follow 


Mount  Vehicle 


Remove  Messa 

Set  hormation 


Shoot 


Use  Shield 


•  Change  Fieid  of 

Change  Visual 

•  Dismount  Vehicle 

•  Light  Flare 


Move 


Select  Weapon 

Set  Path 


•  Take  Over  a 


Use  UDOP  Device 
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Start 
Phase  3 
Maintain 
Contact 


Assault 

Element 


Supportby  Fire  Element 
Moves  by  Bounds 


meters 


OPFOR  2nd 
Position 


Crest  of 
Ridge 
Blocks  LOS 


Start 

Phases 

Prepare 

for 

Assault 


Start 
Phase  4 
Pursue 
OPFOR 
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Proposed  Methods 


Solution  Analyses 


Construct  Scenario  Candidate  Solution  A 


zz 


Record 

Individual  Soldier  Behavior 

Metrics  of  Individual  Skills: 

Frequency 

Speed 

Probability 

Accuracy 

Seed  IWARS  agents 
with  recorded  Soldier 
recorded  values  of 
metrics  of  individual  skills 


zz 


Run  simulations 


zz 


Record  Squad  Performance 


zz 


Generate  forecast  Candidate  Solution  A 
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Observed  Measures  of 

Squad  Performance  with  Candidate  Solution  A 
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Solution  Analyses 


Construct  Scenario  Candidate  Solution  B 


zz 


Record 

Individual  Soldier  Behavior 

Metrics  of  Individual  Skills: 

Frequency 

Speed 

Probability 

Accuracy 

Seed  IWARS  agents 
with  recorded  Soldier 
recorded  values  of 
metrics  of  individual  skills 


zz 


Run  simulations 


zz 


Record  Squad  Performance 


zz 


Generate  forecast  Candidate  Solution  B 
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Observed  Measures  of 

Squad  Performance  with  Candidate  Solution  B 
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•  Each  skill/activity  has  associated  parameters  that  are  to  be  set  by  the 
user  prior  to  running  the  simulation 

•  These  parameters  function  as  the  “insert”  for  Leadership,  Training,  and 
Cohesiveness 

•  Requires  information  about  the  association  between  these  variables  and 
squad  performance 

•  Requires  information  about  these  variables  and  Soldier  and  squad  level 
parameters  of  behaviors 
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•  The  terms  Leadership,  Cohesiveness,  and  Training  were  used  to  search 
databases 

-  The  Army  Research  Institute  for  Behavioral  and  Social  Science  (ARI) 
online  archives 

-  Military  Psychology 

-  Defense  Technology  Information  Center  (DTIC) 

-  Psych  Info 

•  Studies  of  military  groups  were  specifically  targeted 

•  Articles  that  contained  metric  values  that  could  be  in  some  way  inserted 
into  the  IWARs  were  targeted 
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Quantitative  metrics  of  effect  of 
leadership  on  performance 


•  Task-focused  leadership  was  positively  correlated  with  perceived  team 
effectiveness  and  team  productivity  (r=.333  and. 203)  (Burke,  2006) 

•  Leader  effectiveness  was  positively  correlated  with  group  performance 
measures  (r=.39,  .43)  (Vogelaar,  1997) 

•  Leadership  cohesion  (cohesive  bonds  among  platoon  leaders)  was 
found  positively  associated  with  ratings  of  their  unit’s  performance  by 
outside  observers  (r=.52).  (Mael,  1993) 

•  Finally,  toxic  leadership  was  negatively  associated  with  confidence  to 
follow  the  toxic  leader  in  life-or-death  situations  (r=-55)  (Stelle,  2011) 
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Quantitative  metrics  of  effect  of 
training  on  performance 


•  No  articles  addressing  effects  of  specific  military  skills  training  on 
specific  task  performance  were  found 

•  In  contrast  team  training/team  process  training  effects  studies  were 
numerous 

•  Team  process  was  positively  correlated  with  number  of  targets 
destroyed  (r=.30)  (Stout,  1994) 
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Quantitative  metrics  of  effect  of 
cohesiveness  on  performance 


•  Using  a  well-validated  measure  of  military  group  cohesiveness, 
horizontal  cohesion  among  Soldiers  was  positively  correlated  with 
mission  performance  (r=.52)  (Siebold  G.  ,  The  evolution  of  the 
measurement  of  cohesion,  1999) 


•  Meta-analytic  studies  also  show  a  consistent  moderate  correlation  with 
performance  (around  r=.4)  (Siebold  G.  ,  Key  questions  and  challenges  to 
the  standard  model  of  military  group  cohesion,  201 1)(Oliver,  1999) 


•  The  literature  reveals  moderate  correlations  between  these  psychosocial 
variables  and  collective  (squad,  platoon,  and  team)  performance 

•  While  there  exist  numerical  values  representing  the  relationship  between 
psychosocial  variables  and  team  performance,  the  questions  revolve 
around  the  appropriate  methods  for  inserting  these  data  into  IWARS  or 
other  modeling  and  simulation  programs 


•  Locate  Army  standards  or  normative  data  on  leadership,  training,  and 
cohesiveness  measures  (Siebold  G. ,  The  evolution  of  the 
measurement  of  cohesion,  1999)  (Oliver,  1999)  and  Squad  performance 
in  the  react  to  contact  battle  drill,  if  they  exist 

•  Simulation  experiments  examining  the  effects  of  varying  degrees  of 
leadership,  training,  or  cohesiveness  solutions  on  squad  performance 
can  create  input  data  seeds  to  IWARS  by  derivations  using 
standards/norms  multiplied  by  the  correlational  factors  reported  in  the 
previous  section 

•  A  similar  method  is  to  designate  seed  data  as  representing  squads  that 
are  categorized  at  different  points  on  the  spectrum  for  these  variables 
(High,  Med,  and  Low),  again  with  relative  values  inputted  based  on  the 
correlational  factors,  and  anchored  at  one  of  these  points  based  on 
standard  or  normative  data 
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•  Difficulty  in  locating  standard  or  normative  data  (?) 

•  Heterogeneity  of  leadership,  training,  and  cohesiveness,  as  well  as 
performance  measures  may  also  present  problems 

•  Static  vs  Dynamic  Issues 

-  Archives  are  static  measures,  M&S  is  a  dynamic  scenario. 

•  Granularity  Issues 

-  Archives  are  overall  relationship,  M&S  requires  relation  to  specific 
behaviors 
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Generation  of  Baseline 
Empirical  Data 


•  Data  collection  in  the  laboratory  should  then  focus  on  recording 
execution  of  these  component  performance  skills 

-  Test  bed  set  up  must  allow  for  observation  or  recording  of  these  skills 


•  motion  capture  methods  and  video  recording  methods 

•  Data  are  processed  to  yield  numerical  values  indicating  Soldier  and 
squad  behavior 


-  distance  between  Soldiers,  time  between  commands  given  and 
commands  executed,  frequency  of  Soldiers  going  prone,  number  of 
trigger  pulls,  and  speed  of  movements 

-  numerical  indices  of  overall  squad  performance 


•  These  numerical  values  are  then  used  to  configure  parameters  of  the 
skills  and  activities  in  IWARS 


-  options  and  parameters  controlling  the  agents’  activities  are  set  to 
match  those  recorded  in  the  lab 


.  MakDtmFtafcir*! 

National 

'£z$r 

^007AwanI 


TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 
UNCLASSIFIED 


Example  of  Alignments  among  Performance  Step, 
Data  Collection  and  Processing,  and  Skill 
Configuration  for  Task  071  -326-0501  -  Move  as  a 
Member  of  a  Fire  Team 


Doctrinal  Performance 
Step 

Ty  pe  of  La  bo  ra  to  ry 
Data  Collected 

Data  Processing  far 
Qpa  ntitat  ive  Metrics 

Skill  Corf igu ration 
in  IWARS 

1.  Ass umeycur  positio n 
in  the  fire  team's 

current  formation... d. 
Assu  me  you  r  posit  in  n 
within  the  fire  team  file 

fo  rm  at  io  n . 

Motion  Capture 

Distance  between 
Soldiers,  Leading 

Edg^T railing  Edge 

D  isp  ersio  n 

Activate  Motion,  Set 

Formation 

NOTE:  The  normal 

distance  between 

Soldiers  is  1C  meters. 

Motion  Capture 

Distance  between 
Soldiers,  Leading 

Edg^T railing  Edge 
Dispersion 

Activate  Motion,  Set 

Formation 

HOT  E:  W  h  e  n  t  he  f  ire 

team  leader  moves  left, 
yo  u  move  to  tfi  e  1  eft . 

W  he  n  th  e  f  i  re  t  e  am 
le  ad  er  gets  dawn,  yo  u 
get  dtavn. 

Motion 

Capture/Video 

Recording 

Lat  ency  b  etw  e  an  F  i  re 
Team  Lead  and  Soldier 

Behaviors 

M  ove,  W  a  it,  Ch  ange 

Agent  Facing, 

Communicate, 

Fo  1  low 

Mjrfwfm  Hating 
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Baseline  Models 


Baseline  Data  Input  and  Validation  of  Model 


Data  on 

Performance 

of 

Warrior 

Skills 


Data  on 
Squad 

Performance 


Output  from  IWARScan  be 
Compared  with  data  on  Squad 
Level  Measures  of  Effectiveness 


Agcnt/Script 

Configuration 

Based  on 

Observed 

Soldier 

Behaviors 


Running 

Simulation 


Forecasted 

Squad 

Performance 
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Comparisons  of  Candidate  Solutions 


Statistical  analyses  comparing  Soldier  and  Squad  Statistical  analyses  comparing  Soldier  and  Squad 

performance  using  candidate  solutions  can  forecasted  performance  using  candidate  solutions  can 
be  done  on  data  recorded  in  the  lab.  be  done  on  outputs  from  IWARS. 


I 

Candidate  Observed 

Solutions  ^Effects 
on 

Warrior 

Skills 


f 

Observed 
Effects  ^ 
on 

Squad 

Performance 


Agent/Script 

Configuration 

Based  on  Running 

Observed  Simulation 

Effects 

on  Soldier 

Behaviors 


t 

Forecasted 

Squad 

Performance 
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Insertion  of  Leadership,  Training,  and 
Cohesiveness  Factors  into  IWARS 


Agent/Script 

Soldier's  and  Squad's  Differing 

Levels  of  Leadership,  Training,  and 
Cohesiveness  are  run  in  the 
laboratory. 

Observed 

Effects 

on 

Warrior 

Skills 

Observed 

Effects 

on 

Squad 

Performance 

Configuration 
Based  on 

Observed 

Effects 
on  Soldier 

Behaviors 
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Squad  Performance  Test  Bed 
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•  Noldus  Observer  XT 

•  Behavioral  Coding  Example: 
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Behavior  Directed  Toward: 

DQ  Dispatch 

■  injured  Victim 

■  Perpetrator 
^  Stud  entf  Staff 
■Team  Member 

■Team  Member,  Student/Staff 

Q  U  nknown/Uni  d  e  ntifi  ed 

■Whole  Team:  36 


•  Federate  IWARS  with  other  simulation  software  programs  that  are 
specifically  configured  for  human  behaviors,  such  as  Brahms,  PMF, 
Imprint,  ACT-R,  SOAR,  etc  (Cassenti,  2010;  Schamburg,  2005;  Laird, 
2012) 
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•  There  exist  methods  of  inserting  data  into  IWARS  simulation  in  order  to 
conduct  systems  engineering  analyses  of  solutions  for  enhancing  squad 
performance 

•  Inserting  data  that  has  been  specifically  collected  for  insertion  into 
IWARS  is  the  most  valid  approach  for  seeding  simulations  (versus  use  of 
data  collected  for  other  uses) 


•  Based  on  this  review  of  the  literature,  these  recommendations  can  be 
made: 

-  Design  of  data  collection  should  be  performed  by  behavioral 
scientists  using  human  experimentation  methods  in  collaboration  with 
computational  engineers  familiar  with  IWARS  or  the  simulation 
program  to  be  used  for  analysis 

-  Standardized  methods  and  paradigms  for  laboratory  testing  of  effects 
of  materiel  and  personnel  solutions  for  squad  performance  and 
insertion  into  modeling  and  simulation  should  be  developed. 
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Questions? 


US  Army  -  Target  Behavioral  Response  Lab 


Elizabeth  Mezzacappa,  PhD 
Picatinny  Arsenal,  NJ 
elizabeth.s.mezzacappa.civ@mail.mil 
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Target  Behavioral  Response 
Laboratory  MORSS  Presentations 


•  Virtual  Employment  Test  Bed:  Operational  Research  and  Systems 
Analysis  to  Test  Armaments  Designs  Early  in  the  Life  Cycle 

•  Method  and  Process  for  the  Creation  of  modeling  and  Simulation  Tools 
for  Human  Crowd  Behavior 

•  Squad  Modeling  and  Simulation  for  Analysis  of  Materiel  and  Personnel 
Solutions 

•  The  Squad  Performance  Test  Bed 

•  Crowd  Characteristics  and  Management  with  Non-Lethal  Weapons:  A 
Soldier  Survey 

•  Effectiveness  Testing  and  Evaluation  of  Non-lethal  Weapons  for  Crowd 
Management 

•  Effects  of  Control  Force  Number,  Threat,  And  Weapon  Type  on  Crowd 
Behavior 
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